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Preface 



The original purpose of this investigation was to 
compare results of a new type of psychological test, 
the Logical Analysis Device (LAD), given to students 
before and after undergraduate engineering study, with 
performance of those students while in college. The 
purpose was modified to use career choice as the outcome 
we sought to predict and to include nine other predictor 
variables recorded prior to college study, as well as 
the results of six hours of tests, interviews and 
questionnaires obtained near the close of the fourth 
year of undergraduate engineering study. 

The LAD was designed to record how a subject solves 
a problem as well as the level of difficulty successfully 
mastered. The form used in this research as well as the 
scoring system were developed by the Psychological ^ 
Corporation of New York City from earlier forms used by 
Miller, John and Rimoldi at the University of Chicago. (12; 
Charles R. Langmuir, who was employed by the Psychologi- 
cal Corporation, directed the administration and 
scoring of the LAD tests. Richard Buchanan and David 
Fitzgibbins were responsible for attempts to impxove the 
methods of scoring the LAD. 

Many of the inter-relationships of the items used 
to assess this small group of 70-100 students are 
interesting to measurement specialists. However, t**e 
main goal of assessing, the LAD as a predictor of career 
performance has not been reached as clearly as hoped for, 
due to the extended period of postgraduate study of a 
large proportion of the students. The author obtained 
estimates during 1967-63 from the students of the type of 
work they expect to be doing in five or ten years, tut a 
graduate student* s view of industrial management vs. 
industrial research, for example, may be quite differen-- 
after he has been out of school for a few years. So, 
although this report concludes the research premised 
under the United States Office of Education sponsorship, 
the solution of the problem requires following the 
careers of these subjects for five or even ten years more 
to see which graduates pursue careers as researchers, 
salesmen, managers, developers, etc. before we can 
conclude how well the LAD and other predictors predict 
the actual career choices. 
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Chapter I 
Summary 

The Logical Analysis Device was used to test the 
problem solving ability of 97 freshmen entering the Cooper 
Union School of Engineering in 1958 and again just before 
82 of these freshmen graduated in 1962. It was expected 
that high scoring students would get higher grades while in 
school and choose more theoretically demanding careers than 
would low scoring students. The freshman and senior year 
measurements were pursued to determine how early the 
aptitude for logical analysis could be measured by the LAD. 
Most prior studies with the LAD had been made with mature 
adults at the peak of their careers. 



The two major goals were improvement of the selection 
of engineering students and improvement in the career 
choices of engineering school graduates. Our hypothesis 
that there would be a high correlation between LAD scores 
and grades while in engineering school was not confirmed. 
The correlation between 1958 LAD scores and 4-year 
cumulative rating was only .14, which is much too low for 
guiding or selecting individuals. The 1 hour 1962 LAD did 
correlate .39 with 4-year college grade average. This was 
significant at the .01 level, but looking backward cannot 
help student selection. 

The second hypothesis has not been confirmed as of 
a 1967-8 follow-up of the careers of 62 of 82 graduates, 
since there is no statistically reliable difference between 
the mean LAD scores of those planning on theoretically 
oriented careers in research or science and mathematics 
teaching as opposed to those entering sales management and 
other less theoretical careers. (See Table I) 



Table I 



Mean-Group LAD Scores for 60 Who Reported Career 
Choices in 1967 and for the Balance of the 
Entering Class 



Career Reported 



No Career Data 



High Theory: Moderate 



Research and Theory 



LAD 


Teaching 


Sales 




Mean 


No. 


Mean 


1958 


10.8 


39 


11. 0 


1962-1 


Hr. 11.6 


39 


11.6 


1962-1% 


Hr. 12.7 


39 


13.0 



etc. 


Grad. 




Not Grad. 


No. 


Mean 


No. 


. Mean 


No. 


21 


8.9 


18 


9.6 


19 


20 


10.4 


18 


10.8 


4 


20 


11.8 


18 


12.5 


4 



The mean 1958 LAD score of the 19 students who left 
Coooer Union prior to graduating was 9.6 which is lo e 
than the average 10.8 for the 39 graduates planning . high 
theory careers, and the 11.0 for 21 graduates planning 
lower-theory careers. However, the 18 graduates wno 
failed to reoort on career plans in 1967-8 were xowest of 
all with an average 1958 LAD of only 8.9. None of 1 these 
averages differ significantly from each other at the .05 
level' and all of the means are higher and less diverse 

in 1962. 

It is possible that real statistical differences 
among the general population of engineering students 
concealed by the limited diversity within this high aptitude 
group. It is also possible that five years after graduation 
is too soon to identify career choices m a group, the 
majority of whom are expected to average seven years before 
completing their Ph D in engineering or science. 

The 1 hr. 1962 TAD results have been included in 
several factor analytic studies of all the tests, 
interviews and career choices of the seniors. The LAD 
showed modest communality with an Embedded Figures Test, 
Spatial Relations and a Mechanical Ingenuity Test It 
also loaded slightly on the factor dominated by mathematical 
and verbal reasoning. Although our hypotheses about the 
values of the LAD as a single predictor of success m 
engineering studies, or later careers appears to be unproven 
there is still a possible usefulness of this test as one of 
a set of factors which are related to career choice. This 
hypothesis will be tested when the experimental subjects 
are interviewed by telephone in a 1970 career follow-up. 

This date should permit completion of Ph D studies by most 
subjects, thus allowing a less restricted choice of careers. 



2 



Chapter II 
Introduction 

The Cooper Union consists of two small , private 
tuition-free colleges in the midst of several million 
people. Each college has always faced a surplus of 
candidates seeking admission and Cooper Union has, during 
most of its hundred year history, used entrance tests to 
choose those who showed the greater premise as students of 
engineering and science, or of art and arcnitecture. 

When Drs. Carl C. Brigham and S. L. Thorndike were 
hired in the 1920's to improve the entrance testing 
procedures, they initiated a program of testing which 
included a try—out of new tests side— by— side with familisr 
tests. Almost every year since that beginning, the 
Coooer Union has included one or more experimental tests 
in the battery given to those seeking admission. However, 
the new test has not been used for selection of students 
until some years later when the experimental students 
have completed enough years of college study so that 
predicted behavior could be „ validated against actual 
behavior. 

In 1958, the Cooper Union School of Engineering 
received 933 applications for admission to the 97 places 
available in the freshman class. Using the College Board 
Scholastic Aotitude Tests (SAT) scores and high school 
average, (modified by double weights in grades in 
mathematics, physics and chemistry), the better 500 
candidates were invited to come to Cooper Union for a 
day of competitive testing in March 1958*. This day of 
testing included 3 College Board Achievement Tests, 
physics, chemistry and advanced mathematics, as well as 
2 experimental tests, the Curtis Sentence Completion 
Test and 3 sections of the Yale Test Battery, Part III 
Verbal Reasoning, Part IV Quantitative Reasoning and 
Part VII Mechanical Ingenuity. 

During the Summer of 1958, the Psychological 
Corporation of Hew York City offered to test these same 
engineering freshmen to assist in the validation of a 
newly developed LOGICAL ANALYSIS DEVICE (LAD) . The test 
was given to each of the 97 freshmen during the week 
before classes opened in September 1958. They were also 
given a half-hour block-counting spatial relations test 
since this test had shown promise in earlier research. 
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The original plan called for a repetition of the LAD 
when the 1958 freshmen became seniors in 1962 to see if 
these test scores had reached a stable plateau as early 
as the freshman year of college, or if maturation or 
engineering studies would produce significant changes in 
LAD performance. 

A testing device suitable for laboratory study of 
problem solving procedures had been developed about 1953 
at the University of Chicago by Killer, John and Rimoldi. 
They called their equipment P.S.I. Apparatus. This 
laboratory equipment had been redesigned for field testing, 
of occupational groups by the Psychological Corporation of 
New York City and renamed the Logical Analysis Device (LAD). 
Preliminary trials of the LAD on computer programmers, 
switchboard trouble shooters and sub-groups of the. medical 
profession indicated that the LAD was a possible indicator 
of whose whose occupation required an orderly, analytic 
approach to problem solving as opposed to others using more 
wholistic or intuitive problem solving methods, (see p.58) 
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Chapter III 
Collecting The Data 

The Logical Analysis Device (LAD) is a machine system 
which allows a subject to solve a series of problems at his 
own pace and in his own way. As the problems increase in 
complexity it becomes necessary for the examinee to develop 
some systematic (logical) procedure for recording or' 
arranging the bits of data gleaned from the machine in order 
to arrive at an effective solution to the problem. After an 
examiner gives the examinee instruction, demonstration and 
an observed experimental trial of the LAD, the examiner 
retires and the subject works in isolation with complete 
freedom as to pace and procedure. A remotely located 
printer and timer records step-by-step the examinee's search 
for a solution. We were limited by funds for examiner time 
in 1958 so we limited each student to a 1-hour time limit, 
but in 1962 with more adequate funding we extended the time 
limit for each student to *90 minutes as had been customarv 
in earlier research with the LAD. Because of the remote 
recording feature of this machine-type testing we could and 
did derive both a 60-minute, and a 90-minute score for the 
1962 examinees. ( 7 ) 

A picture of the part of the LAD seen by the student 
is included on page 58 of this report. The panel seen in 
the picture holds a circular array of nine lights arranged 
around a center light. Each of the nine lights in the 
circle has an associated button which will, when pressed, 
activate that light and it may also assist or prevent the 
lighting of other lights as follows: 

1) Facilitory: Light A can be followed by the 

lighting of an associated light B during the following 
time sequence. 

2) Inhibitory: A prevents B from lighting during 

the following time sequence. 

3) Combination: When buttons near to lights A and B 

are pressed simultaneously, C will light in the following 
time period. 

When the center light is lit using a sequence of only 
a specified three of the nine buttons, the problem is 
solved. 

The first step in solving the problem is to learn by 
trial and error a combination of steps involving all nine 
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buttons which result in lighting the center light. The 
second step involves analysis of what is usually 
unnecessarily involved routine so that unneeded steps may 
be eliminated and the center light lit by use of o ly 
three specified buttons. 

To be sure the examinee has not accidentally reached 
a solution, the examiner may ask for a verbal explanation 
of one or more steps or he may observe the use of 
record observations. 

For a more complete description of the operation of 
the LAD see C. R. Langmuir I960. v 

In 1958, the cost of testing and scoring one student 
with the LAD was about $40.00. It would be prohibit 
to consider such an expensive testing procedure for 
admissions process at Cooper Union, where we usually 
examine 500 to 800 candidates to fill a class of j; 0 ~ 
freshmen. Even using the test on 80 seniors would be more 
expensive than most tests for students seeking career 

guidance. 

However, it was our assumption that if the LAD was 
successful in separating the freshmen who Jj n . 

engineering school from others who would not succeed in 
such studies , or if its use at the senior level predicted, 
which graduates would do well in research careers 
opposed to other graduates whose careers would deal wi 
peoole, as in selling or management, or P^rhapsother 
graduates who would leave the technical 

then test builders could construct “jss-testing devices 
which duplicated to a large extent the fundamental 
measured by the costly, individually ®^ n ^®*®£ 
sample of such techniques would be a test where the exam 
erases an ooaque covering over a chosen answer to discover 
the validity of his choice. The more expertly he proceeds 
in a series^of choices the fewer answers need-be uncovered. 
The individually administered Binet test of intelligence 
is likewise expensive, but it led to the development of 
hundreds of paper and pencil in*®!* 1 ^® 110 ® . t ? s ^ s 
suffice for most situations and which cost far less to 

administer. 

In January 1962 while plans were being made for 
giving LAD tests, to the seniors who had. entered Cooper 
Union in 1953, a research team from the Organization 
Psychiatry Division of Mount Sinai Hospital approached 
Coooer Union with a proposal to' see if any of our 
experimental tests would be helpful m their efforts to 
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improve the job placement of scientists in industry. Their 
findings will not be included in this report unless related 
to the LAD test. 

They were also interested in the connection between 
various cognitive controls and career choice in engineers 
and scientists. They decided to join with Cooper Union in 
testing and interviewing the 1962 senior class and to 
participate in matching their test and interview data 
against the career development of these students. The^ 
students were paid ten dollars each for participating in 
three hours of group testing, about three hours of 
individual testing anyone hour structured interview by one 
of two psychiatrists. The senior-year tests and interviews 
were conducted between the end of classes in May and 
graduation in early June of 1962. The group tested 
included 70 who completed the 4-year curriculum on schedule, 
5 who were still attending Cooper Union but were not yet 
ready to graduate and 6 who had separated from Cooper Union 
but were attending nearby colleges and willing to return for 
re-testing on the LAD. The two girls and those out of 
school who were re-tested on the LAD were not included in 
the other senior year tests and the interview. One 
graduating senior did not take the senior— year tests. 

Each student interviewed agreed to permit tape 
recording of the interview so that each of the two inter- 
viewers could rate the entire class on personality 
functioning, adaptation and defenses. 

The students completed an autobiographical 
questionnaire developed by Morris I. stein covering 
family background, personal development, school career 
and growth of scientific interest. 

Two cognitive controls were assessed to see if they 
were related to choice of engineering major or to later 
choice among engineering-science careers. These controls 
were field articulation and physiognomic perception. 
Cognition includes such ego functions as perceiving, 
recognizing, judging and reasoning. Individual 
consistances or styles have been observed and it was our 
hypothesis that such styles or patterns of intellectual 
behavior could be associated with ego structures which 

determined career preferences. ' 3, 4, 5 ) 

Field articulation has been described as the ability 
to focus attention without being distracted by COTipeting, 
irrelevant stimuli* Earlier studies have shown that 



7 



oersons with high field articulation are more active in 
dealing with their environment, have a sophisticated, 
differentiated body image and selective control over 
emotional impulses as opposed to those with low field 
articulation who exhibit more massive repression of 
impulses, general passivity, and primitive undifferentiated 
body images. Rationalization is more often associated 
with high field articulation than with low. 

The other cognitive characteristic which was assessed 
for members of this group was physiognomic perception. 

This has been defined by Werner ( 28) as a mode of perception 
in which objects are predominantly regarded through the 
motor and affective (or emotional) attitudes of the subject. 
Children who talk to their dolls or imaginary playmates 
and adults who angrily kick the flat tires on their 
automobiles are examples of seeing the world through a high 
physiognomic mode of perception, while the boss who thinks 
of his employees as barely distinguishable from the 
machine they operate in his factory would be classed as 
low physiognomic. 

Field articulation was measured by at least six of the 
tests in this research: The Logical Analysis Device, 

Draw-a-Person Test, the Stroop Color Word Test, the 
Written Association Test, The Embedded Figures Test, and 
the vocabulary subtest of the Wechsler Adult Intelligence 
Scale. A single test, The Psysiognomic Cue Test, devised 
by Stein, Stern and Lane (25) was used to measure the 
second factor. 

Our students were rated by one or two faculty members 
who knew them and they rated each other on the number of 
ideas, quality of ideas, originality of ideas, communication 
of ideas, research aptitude, industry and on personal 
liking. The seniors* also completed the Thurstone Interest 
Schedule, the Stein Working Conditions Questionnaire and 
repeated the Curtis Sentence Completion Test they had 
taken as freshmen. (2) 

It may be easier for the reader if we tabulate the 
titles of the various kinds of data collected before 
proceeding with a brief description of each item. 

I 1953 Freshman-year Data 

4-year High school Average Grade, weighted heavier 

on math and science subjects. 
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5 College Board Test Scores : 

SAT Verbal, SAT Math, Advanced Math, Chemistry and 
Physics. 

6 Experimental Test Scores: 

The LAD - 60 min. limit, the Curtis Sentence 
Completion Test, Spatial Relations with block 
counting type problems and 3 scores from the Yale 
Test Battery: Part III, Verbal Reasoning, Part IV, 
Mathematical Reasoning and part VII, Mechanical 
Ingenuity. 

II 1962 Senior Year Data 

LAD 1 hour and 90 min. limits 

New Test - Watson’s Imagination Test 

Mount Sinai Research Data 

45 Min. interview and following day, 

dream report 

WAIS Vocabulary Test 

Draw-A-Figure Test 

Color-Word Interference test 

Free Association Test 

Embedded Figures 'Test (EFT) 

Kent-Rosanoff Word List 
Thurstone Interest Schedule 
Stein-Biographical Questionnaire 
Stein-Working Conditions Questionnaire 
1965-California Personality Inventory - 
collected by mail 

III Criterion Data 



Grades - Undergraduate and graduate, 1962 Ratings - 
Faculty rated seniors on;; number, quality, 
originality and communication of ideas, on 
aptitude for research, on industry and on personal 
liki ng . 

Senior Students rated seniors on same items as 
faculty. 

The high school average, the College Board Test 
scores and the LAD do not require further description. 

The Curtis Completion Form was listed and described in 
the catalogs of the publisher, Science Research Associates, 
Chicago during the period of this study. It is now out of 
print. It consists of 52 sentence stems to be completed 
as the examinee chooses. High scores reflect unusual 
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numbers of responses involving feelings of antagonism, 
self-oity, uncertainty, escape, fantasy and frustration, 
or a fear of response lest undesirable feelings be 
displayed. ( 2 ) 



Spatial Relations was measured by a Cooper Union 
test of 24 piles of blocks like similar sections of the 
old College Board Spatial Test. 



Yale E ducational Aptitude Test was originally a 
battery given to guide admitted Yale student s among 
various curricular offerings at Yale. Later it was 
released to the Educational Records Bureau of New York 
City for commercial distribution. The Verbal Reasoning 
and Quantitative Reasoning sections appeared to be more 
dependent on analytic thinking than the SAT Verbal and 
Mathematics Tests, while the Mechanical Ingenuity section 
was potentially helpful in spotting the boy more used to 
analyzing problems in real machinery, as opposed to verbal 
or mathematical problems. * 



The author 1 s ima gination Test has never been copy- 
righted. It consisted of .10 basic outline shapes such as 
a side view of a cigarette'. The examinee was asked to 
search his imagination for as many real objects whic 
contained each shape and to sketch each such subject. For 
example: the cap of a fountain pen, one section of a 

banded fuel pipe", a handle of a dresser drawer, etc., etc. 
Scoring consisted of a count of the total number of 
objects attempted less those with obvious distortions of 
the original outline, such as changing the cigarette 
outline to be pointed at one end. 



The Mount Sinai tests and interviews will be 
described in the reports of Rosett, et al. 
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Chapter IV 
Fi ndi ng s 

We started the research with two hypotheses, first 
that freshman LAD scores would be relatively unchanged 
during 4 years of college, and second, that the freshman- 
1gv©1 scores, (or others tslcen in the senior yesr) could 
be useful predictors of career choices within the various 
occupations followed by engineering graduates of The 
Cooper Union, It should follow as a corollary, that 
students who left college before graduation because they 
felt unsuited for engineering studies would have lower 
LAD scores than others who graduated. Among those who 
graduated, those choosing research should show higher LAD 
scores than others in sales, management, development or 
teaching. 

In Table II, the reader can see by inspection that all 
occupational groups who stayed for re— testing in 1962 made 
significant gains during the 4 years of study. The "E u 
group, who shifted to non-engineering, non- science 
occupations and the group which failed to supply 
occupational data were also the two lowest scoring LAD 
grouDS at the time of freshman testing. However, they were 
not enough lower than our 1958 "B" group to explain why 
these students left Cooper Union while others stayed and 
rai'sed their LAD scores to almost ceiling levels. 

When the author prepared Table II he noted the 
absence of scores in the "15" category during the 1962 
testing session so he prepared Table III to compare the 
1958 test scores. It i.s clear that all students who 
scored 15 in 1958 scored either 14 or 13 on their second 
attempt in 1962, while the 14‘s either scored the same 
or dropped. 

The 13* s stayed at the same average while the 12‘s 
showed an 0.8 increase in average. The author guesses 
that this represents a changed scoring procedure rather 
than a real loss in performance for those at the top of 
the scale. The higher level of performance on the second 
test for those scoring below 12 on their first attempt 
rules out a general lack of motivation as a reason for 
any losses on the second round of testing. 
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Table III 

FREQUENCY COMPARISON 
1958 LAD SCORES VS 1962* LAD SCORES 



1958 1962 SCORES 1958 

SCORES 6 7 8 9 10 11 12 13 14 15 SUMS 



15 














3 


3 


6 


14 










1 




4 


5 


10 


13 










1 




2 


3 


6 


12 








y 


1 


3 


4 


2 


10 


11 














2 


4 


6 


10 








l 


2 


2 


4 


2 


12 


9 








■ 




2 


3 


2 


7 


8 

t 








l 




4 


1 


1 


7 


7 




2 


1 


2 


2 


4 


3 


2 


16 


6 








1 


1 








2 


1962 

SUMS 


0 0 


2 


1 


5 


8 


15 


26 


25 


0 82 



* 90 Min. 







Table IV was prepared from initial returns to a. 
career questionnaire mailed to tne research students 
May of 1968, supplemented by replies to 1966 und 196/ 
correspondence ’in a few cases where no 1968 returns were 
received. The Table I Research group was now divided 
into Basic "A" and Applied H 3" and teaching was split 
into Science-Engr-Kath "E" and those teaching history, 
etc. were grouped under "F“ for other careers. Sales 
was now clearly listed under the Technical-Service- 
Engineering category which was n D" on this round of 
questions. 



It is apparent by inspection of Table IV that a 
relatively low score on the LAD in 1958 did not indicate 
inability to prepare for research or engineering career. 
Note that students with 7 of the 10 lowest LAD scores 
report "A u , “3" or "C" careers. 



However, all but 4 of the 49 of these respondents 
tested again in 1962 had lifted their LAD scores to 11 or 
higher, and the 9 who were headed for theoretical research 

had 1962 LAD's of 13 or 14.,. 



The general pattern is apparent also in Table III 
where 51 of 82 tested in 1962 had scores of 13 or 14 and 
74 out of 82 scored in the 4 point range of 11-14. 

Roughly similar results were found in research into _ 
spatial relations and engineering grades and on-the-job 
aptitude tests. Engineers on-the-job and senior-student- 
engineers were significantly more ( skilled in dealing wi 
spatial test problems than the general public who 
presented similar verbal IQ measurements. However, st 
the time of entrance to college, these same seniors had 
presented a much wider (and lower) range of spatial test 

skills. 



It seems reasonable to the author to conclude that 
the type of problem-solving skill measured by the LAD is 
probably essential for most technical-mathematical 
research, production, design and teaching careers. 

However, a low score at college entrance does not prove 
that the student is unable to acquire the needed skill 
in college. We do not yet have proof that a low score 
at graduation from college bars such careers. The four 
or five subjects with scores below 10 who still planned 
on research or design-oriented careers may have found 
areas of research or design where LAD skill is not 
essential, just as we train color-blind artists who design 
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LAD SCORES FOR 1958 AND 1962* VS 1968 ESTIMATE OF 1970 OCCUPATION 
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qi ass formations, etchings, type-faces and work in many 
Leas of design where color distinctions are not essen 
Or these low LAD students may have false hopes fo 
success in an area where they lack the needed skill. 

The author plans on a further career *ollx«£*9 
t • *1 rnn t+* “i c* oil v llODS to Td© 5 lbl 6 to pxH 

H^iEkguish^hfLre'and iLf suScesLulterfomances 

in the various careers. 

Two measures of reliability of the LAD were 
recorded., A comparison of the scoring 

1958 test results showed a correlation of .yu. 

The second measure of reliability involved comparison 
r- the 1958 scores with the 1-hour re-test scores in 1962. 
■mis correlation was .683. To the author this seems very 
satisfactory when he considers the restriction . o 9 

f i itv resulting from the initial selection for 

admission to Cooper Union and the ^^inrLudy 10 " 
resulting from the four years of engineering study 

Erected 9 towards lifting all of the st ^ ent * 

r»r at the ceiling of this test. The correlation of 

the 1-hour 1958 LAD test with the lk hour 1962 LAD was 
.502. 

Tn Table V one can see the median LAD scores arranged 
in rows by branch of engineering studies, and in column A 
al^ freshmen tested in 1958, in column 3 the freshmen 
scores of those who graduated and in 4 re _ 

the 1 hour and 1^ hour senior-year LAD scores as 

measured in 1962. 



Table V 

median lad scores 



Course 



Chem 

Civil 

Elect 

Mech 

ALL 



A 

rp 0 4- *58 


B 

Grads *_58_ 


C 

•62-1 Hr. 


D 

*62-1% Hr. 


lUw« 

9 0 


9.8 


10.4 


12.0 


9.3 


9.3 


11.0 


12.6 


10.0 


11.0 


11.8 


13.3 


10.9 


10.9 


11.6 


13.3 


10.1 


10.2 


11.2 


12 • 9 
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Although none of the medians in the rows or columns 
differs at the .05 level of significance from the 
r^naining items, there are trends worthy of note. The ^ 
maximum difference of 1.7 between curricular group medians 
in column B, or of 1.4 in column C was greater than the 
1.0 difference between the median scores for all students 
in columns C and 3. Or again looking at column B, we 
find that the electrical and mechanical freshmen have 
median scores of 11.0 and 10.9 while the senior chemicals 
in column C have a median score of only 10.4. We did not 
expect any group of seniors to score below freshmen an 5| 
there is no data from entrance test scores or grades while 
in school to explain this difference between our chemical 
engineering majors and our other students. On College 
Board tests or on freshman grades the chemicals clearly 
out score both the mechanical and civil groups • Finally 
we note that a median of 12.9 on the 90 minute 1962 test 
is too close for ccmfort to the 1962 ceiling of 14.0. 

These observations suggest the desirability of studying 
the differences among other samples of ^engineering 
curriculum groups on other campuses and in larger 
quantities if feasible so that we can be sure the 
differences were not an accident. 

How well did the LAD predict engineering grades? The 
1958 LAD had an r. of .28* with freshman grade average, 
and .14 with the 4-year cumulative average. The 1962 
one-hour LAD showed an r. of .39* with the 4-year 
cumulative which is far from equal to a .61* which we 
found between our usual predictor (HSR plus CEBB tests) 
and cumulative grades for four years at Cooper Union. It 
is apparent that no senior-year test can offer much aid 
in selecting freshmen, unless the test also has validity 
at the pre-f reshman level. 

Every student who started at Cooper Union in 1958 was 
offered $12.00 to reoeat the LAD and take other tests in 
1962. 75 out of 76 students still attending Cooper Union 

responded and 6 others out of 20 still living and out of 
school volunteered to return for re-testing. 



tests under the heading" “Repeaters “ and the 15 who did 
not return under the heading of “Research Drop-Outs • 



♦Significant at .01 level 



In Table VI we group the 81 who returned for 1962 



VI 











In Tables VII through X we present further attempts 
to find differences among the four curricular groups. 
However, the 19 to 21 students in each group are such a 
small sample that refined statistical analyses of the 
differences did not seem worthwhile. 

On academic tests such as the SAT our four curriculum 
groups ranked Electrical, Chemical, Mechanical, Civil. 
However, on the LAD the Mechanicals move up to second and 
the Chemicals are third in 1958 and fourth in both 1962 
LAD averages. The Mechanicals even exceed the Electricals 
when we include the two research drop-outs in their 1958 
average score 

In Table VIII the Chemical group appears somewhat 
heavy at the upper and lower ends of the scale. Having 
eleven students in the 6 and 7 score range may account for 
nine Chemical students leaving Cooper Union before 
graduation compared with no more than four from any of the 
other 3 sections. We have no way of knowing whether the 
gap between SAT scores and LAD performances of this 
Chemical group and the reverse gap for the Mechanicals 
was an accident or perhaps characteristic of other similar 
Chemical and Mechanical engineers. 

The column of research drop-outs shows a slightly 
lower mean than those who completed the research but 
inspection of the distribution of drop-outs on the four 
groups in Tables VIII and IX reveals no clear pattern. 

The distributions of 1962 scores by departmental 
majors is shown in Tables X and XI. The Chemicals had 
six ratings of 14- in 1958 on the 1 hour test (Table VIII) 
but can place only 2 in the 14 category in either of the 
1962 test ratings. They show only .42 gain in average 
1 hour score, the lowest of any of the four groups. The 
massing of the other three curriculum groups so close to 
the ceiling of the test scale on the 1 H hour test shows 
that the shorter time limit of 1 hour is a more effective 
procedure if speed of analytic thinking is important, 
while the other 1H. hour limit may be a better measure of 
analytic skill without regard to speed. This is commonly 
referred to as a power test. 

Two separate studies were made to see if we could 
develop improved separation of the curriculum majors of 
of the prediction of grades in engineering school through 
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the use of more refined methods of scoring the LAD. The 
first attempt was reported by R. Buchanan of the 
Psychological Corporation in June 1963 and in included 
in the appendix of this report as Item No. 1. 

The second study was an attempt by Rosett & Robbins 
of Mt. Sinai and David Fitzgibbons of the Psychologica! 
Corporation to develop new LAD scoring techniques which 
would be more closely related to the Mt. Sinai personality, 
cognitive and intellectual factors. 





Table 


VII 






LAD 1958 Test 


Scores 




LAD 1962 


Test scores 


Research 

Repeaters Droo-Outs 


Total 


1 Hour 


1.5 Hours 


Chemical Enqineers 
N = 19 

Mean = 10.16 


7 

9.14 


.26 

> 9.88 


19 

10.58 


19 

11.84 


Civil Enqineers 
N = 21 

Mean = 9.33 


4 

9.50 


25 

9.36 


21 

11.00 


21 

12.26 


Electrical Enqineers 
N - 20 2 

Mean = 11.00 8.00 


22 

10.74 


20 

11.55 


20 

13.20 


Mechanical Enqineers 




21 

11.57 


21 

13.14 


N = 21 

Mean = 10.95 


2 

11.00 


23 

10.96 


Total 

N - 81 

Mean - 10.36 


15 

9.20 


96 

10.06 


81 

11.27 


81 

12.59 
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Table VIII 






DISTRIBUTION OF 1958 LAD SCORES 



For Chemical 
Engineering Student s_ 
LAD Research Total 

Scores Repeat ers Dr op- Outs Group 



14 

13 

12 

11 

10 

9 

8 

7 

S 

5 

N = 
Mean = 



6 

1 

1 

2 

1 

7 

1 

19 

10.16 



1 

2 

1 

7 

9.14 



For Civil 

Engineering Students 

Research Total 
Repeaters Drop-Outs Group 



7 

1 

2 

3 

1 

1 

9 

2 

26 

9.88 



1 

3 

3 

3 

3 

2 

5 

1 

21 

9.33 



4 

9.50 



1 

1 

4 

3 

3 

3 

2 

6 

1 

1 

25 

9.36 



Table IX 

DISTRIBUTION OF 1958 LAD SCORES 



For Electrical 
Engineering Students. 



LAD Research Total 

Scores Repeaters Drop-Qurs Group 



14 

13 

12 

11 

10 

9 

8 

7 

6 

5 

N = 
Mean = 



7 

2 



2 

3 

2 

3 



20 

11.00 



1 

1 

2 

8.00 



For Mechanical 

Engineering Students 

Research Total 
Repeaters DroP-Outs Group 



7 

2 

1 

2 

4 

2 

4 



22 

10.74 



3 

2 

3 

4 

5 
1 
2 
1 



21 

10.95 



1 

1 



2 

11.0 



3 
2 

4 
4 
6 
1 
2 
1 



23 

10.96 



21 




LAD 

Scores 

14 

13 

12 

11 

10 

9 

8 

7 

N = 
Mean = 



LAD 

Scores 

14 

13 

12 

11 

10 

9 

8 

7 

N = 
Mean = 



Table X 

DISTRIBUTION OF 1962 LAD SCORES 



For Chemical 
Engineering students 

1962 1962 

1 Hour 1 . 5 Hours 



2 

2 

1 

4 

4 

4 

1 

1 

19 

10.58 



2 

5 

5 

4 

2 

1 



19 

11.84 



For Civil 

Engineering students, 
1962 1962 

1 Hour 1.5 Hours 



4 
2 
2 

5 
1 
5 
1 
1 

21 

11.00 



5 

6 
5 
2 
2 

1 



21 

12.26 



Table XI 



DISTRIBUTION OF 1962 LAD SCORES 



For Electrical 
Engineering Students 
1962 1962 

1 Hour 1.5 Hours 



5 

3 

3 

7 

1 

1 

20 

11.55 



9 

6 

4 

1 



20 

13.20 



F:or Mechanical 
Engineering Students 
1962 1962 

1 Hour 1.5 Hours 

5 
3 
2 

6 
1 
2 
2 



21 

11.57 



9 

9 

1 

1 

1 



21 

13.14 
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Re-reading of the tapes that recorded the original 
1962 1 hr performance by each student produced 27 new 
scores each possibly related to personality and cognitive 
style scores, or to ratings. None proved better than the 
original 1 hr score and none of the multiple correlations 
were significant at the .01 level. 

However, a table of the simple correlations between 
the 1962 LAD 1 hr test and the other 19 non-LAD variables 
may give the reader a view of the efforts underway to 
group and inter-r elate grouped items from our larger 
lists of indeoendent measures of each student » 



1 . 

2 * 

3. 

4. 

5. 

6 . 

7. 

8 . 
9. 

10 . 

11 . 

12 . 

13. 

14. 

15. 

16. 

17. 

18. 
19. 



* 

** 



Table XII 

CORRELATION BETWEEN 1962 LAD 1 HR TEST SCORE 

AND 

19 COGNITIVE AND INTELLECTUAL VARIABLES 

Self Esteem 
Driving Ambition 
Theoretical Abstract Interests 
Projective Self Esteem ’.r 
Prefer Management to Exclusive 
Scientific Interest 
Low Autonomy 
Esthetic - Expressive 
Obsessional Openness 
"F “ Scale 

Creativity by Faculty 
Creativity Given to Peers 
Personal Liking from Peers 
Score 
Score 



Personality 
Z Scores 



Ratings of 
Ratings of 
Ratings of 
Phvs-Cue A 
Phys-Cue B. 

Academic Achievement 
Physiognomic 
Scanni ng 

Field Articulation 
Abstract Reasoning 



Significant at .05 level 
Significant at .01 level 



Cognitive 
Z Scores 



r. 

.09 

.15 

.05 

.15 

>30** 

.10 

.14 

.07 

>19 

.32** 

.08 

>05 

>05 

.00 

.16 

>04 

.07 

.37** 

.27* 





Items 1 through 8 in Table XII are Z scores based upon a 
nine factor analysis of the personality test (CPI) and 
interview rating data, items 9 through 14 are the scores 
on individual personality tests or on ratings, while the 
final 5 items are based upon Cognitive style Z scores. 

We note that a high LAD is negatively related to a 
preference for management -.30 and positively related to 
faculty ratings of student creativity .32, to the Field' 
Articulation Factor score .37 and to the Abstract 
Reasoning Factor .27. The first three are significant at 
the .01 level and the fourth at the ,05 level. 

One of several factor analyses of the cognitive and 
intellectual items in our data files was the basis of a 
paper ( 19) presented to the Educational! Research 
Association of New York State at Albany in November 1966. 

It was our hypothesis that factor analyses of the school 
and college grades of our students and the related entrance 
test scores and personality test scores would reveal 
patterns of communality not readily apparent by inspection 
of the tests. Thrs follows from studies such as ( 13) 
which show little or no correlation between college grades 
and a number of criteria of job performance. There has 
been increasing evidence that personality characteristics 
frequently are dominant in determining career success. 

We hoped that grouping our data into a few groups of 
related items would produce Z scores for our students which 
would tie-in with career choices and career success even 
though none of the nineteen separate items analyzed was a 
useful predictor by itself. Prior research had led us to 
expect that three general areas of personality we re 
related to engineering careers. These related areas of 
personality are also called cognitive control principles. 
They were: Field Articulation which represents a general 

ability to direct attention without distraction by 
opposing stimuli. We used an embedded figures test (EFT) 
for this factor? scanni ng , or the ability to search one's 
mind rapidly and widely in a directed manner just as a 
good librarian finds more related references in a minimum 
of time. We used free association to the word DRY to 
evaluate scanning. The third cognitive control we called 
Physiognomic Perception . This represents a tendency to 
react to objects as symbols, or feelings, rather than as 
geometric or literal descriptions to measure this 
tendency. The test we used was called Physiognomic Cue. 
Literal, geometric descriptions were opposed to feelings 
in half the items and the other half of the items required 
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a choice between literal descriptions and symbolic 
descriptions. A preference for a feeling response 
resulted in a high "A“ score, and a preference for a 
symbolic response resulted in a high “B" score. The two 
responses were related, but distinguishable from each 
other and together they made uo a total score which was 
opposed to a literal response. ^ 22 ) ' 

In Table XIII one can see the list of 19 items 
analyzed and the five factors resulting. The factor names 
are arbitrary titles selected by the author on the basis 
of the heavier beta weights in each column. Inspection of 
Factor I, which we called Academic Achievement, reveals 
that several items are not as closely connected to college 
grades as one usually finds them in correlational analyses 
of independent items. For example note: Yale Verbal 

Reasoning -08, SAT Verbal -04, Yale Mechanical Ingenuity 
-17, % Distant Units -12, CESB Physics 05. However, note 
that “ giving the common response 11 rates 39. From this data 
one could conclude that during the period 1958-62 the way 
to get good grades at Cooper Union did not depend very much 
upon reasoning or ingenuity. 

The 1 hr. 1962 LAD loads with low positive weights 
on the first three factors but clearly belongs almost 
equally to factors IV (Field Articulation) and V (Abstract 
Reasoning). As companions in Factor IV the LAD 39, finds 
the Cooper Union average grade 37, CEE3 Adv. Mathematics 42 
the Embedded Figures Test -71, Block Counting Spatial 68, 
Yale Mechanical Ingenuity 56 and CESB Physics at 30. The 
minus beta weight on the EFT results from using elapsed 
time as a score. A low score means high ability. 

However, in Factor V which we have called Abstract 
Reasoning many of the factor IV items lose their 
association. Adv. Mathematics 33 is still there, while 
Yale Mech. Tng. 53, LAD 37, and CEE3 Physics 24 are about 
the same as on the Factor IV. The new companions in 
Factor V are: Yale Verbal Reasoning 72, SAT Verbal 61, and 
Yale Quantitative Reasoning 45. The low loading of 04 for 
Cooper Union Average and -11 for high school average 
re-confirms our conclusions from Factor I. The differences 
in verbal and reasoning skills have little to do with 
grades in high school and college among such a narrow range 
of abilities found in this sample of engineering students. 
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Th© results of tli© interview session aopear to be of 
peripheral interest to most readers of this study of the 
LAD with the exception that the same pattern of intense 
concentration needed to do well on the LAD or the 
Embedded Figures Test can be interpreted in quite a 
different light when such behavior reaches extremes. A 
skinny toy who would rather study than .eat, looks good to 
his teacher and bad to his mother. 

In an unpublished paper presented to his colleagues 
at Mt . Sinai in the fall of 1968, Henry L. Rosett, M.D. 
presented the results of a series of factor analyses and 
correlation studies which grouped 59 personality variables 
into 9 factors, the 19 cognitive variables were reduced 
to 6 factors and a 65 item Work Attitude Questionnaire 
completed by 60 of our subjects in 1967 was reduced to 
7 factors. 

It was his hypothesis that such clusters of related 
variables were more apt to lead to understanding of 
career choice and career success than the study of group 
means on individual variables such as IQ, LAD scores, etc. 

Each of the 60 seniors' who responded to the Work 
Attitude Questionnaire was given a Z score on each of the 
15 predictor factors as well as the 7 WAQ factors. Such 
scores were derived from each student's score on the 
separate variables multiplied by the dominant beta weights 
of” the variables participating in a factor. 

In Table XIV below we list the multiple correlations 
resulting from 3 calculations. In the first row the 
cognitive factors alone were used to predict the 7 WAQ 
factors. Only factor VI - Administration reaches a 
statistically significant level. In the second row the 
personality factois alone were used to predict the WAQ 
factors and 3 of the 7 were significant at the 05 level 
or better. In the third row we see the results of 
using all of the cognitive and personality data to 
predict WAQ factors. The resulting correlations are higher, 
but the larger number of predictors increases the chances 
of accidental relationships so that we still find only 3 
statistically significant correlations in row 3. 

The hypothesis that clusters of predictors would 
be better predictors of clusters of Work Attitudes is 
upheld. We found no significant difference in mean LAD 
scores as predictors of these reporting theory oriented 
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careers as opposed to sales, management, etc. But by this 
factor analytic grouping of predictor items and career 
preferences, we do find some significant relationships 
between variables assessed in the senior year, or earlier, 
and the students' work preferences five years later. 



Table XIV 

MULTIPLE R: WAQ FACTORS WITH COGNITIVE 

AND PERSONALITY VARIABLES • 

WAQ Factors 
Dependent Variables 



Independent Variables 


I 


II 


III 


IV 


V 


VI 


VII 


Cognitive alone 


.34 


.21 


.30 


.28 


.39 


.50** 


.33 


Personality alone 


.47* 


.53** 


.31 


.38 


.45 


.59** 


.30 


Cognitive and Person- 
ality combined 


.55 


159* 


.44 


.47 


.59* 


.71** 


.49 



* p <.05 
** P <* 01 



WAQ Factors : I = Professional reputation and 

status 

II » Critical thinking 
III = Practical experimentation 
IV = "Playing with ideas" alone 
V = Congenial and practical work 
VI = Administration 
VII = Intellectual independence 



The reader may wonder what happened to the LAD in the 
grouping and re-grouping of our data. It was one of the 
individual variables used to determine two of the cognitive 
variables, Field Articulation and Abstract Reasoning. In 
Table XV which follows, we find no correlations for these 
two factors which are significant at the .05 level, 
although 6 of the total of 42 correlations do reach at 
least the .05 level. 

The partial correlations between personality factor 
scores and the 7 WAQ factors are presented in Table XVI 
while the partial correlations for the 15 cognitive and 
personality factors are presented in Table XVII. The 
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names of the factors are arbitrary titles selected by 
the author to identify the leading determinants of- each 
factor. The reader may wish to examine some items which 
came near to the .05 level of significance as well as 
those reaching or exceeding it. For example in Table XV 
Column V, the WAQ factor related to a preference for 
Congenial and Practical work shows a significant 
correlation of .26 with the Physiognomic Cue Test B score. 
But 3 other negative correlations of .19 or larger are 
also listed? -.19 for Academic Achievement, -.21 for 
Abstract Reasoning and -.20 for the PCT - A score. All 
three correlations suggest probable re3.ationships that 
could be significant if our research population was 
larger, more diverse and more settled in their work. A 
proposed career follow-up in 1970 should produce more 
definitive career preference responses. Selection of a 
larger more diverse experimental population must wai<- for 
an entirely new study. 



Table XV 

PARTIAL R; INDIVIDUAL COGNITIVE VARIABLES WITH 

7 WAQ FACTORS 



Cognitive Variables 


I 


II 


III 


IV 


V 


VI 


VII 


Academic Achievement 


-.26* 


-.10 


-.24* 


.11 


-.19 


-.30** 


-.18 


Scanni ng 


-.02 


-.16 


-.14 


-.01 


.06 


-.19 


.02 


Field Articulation 


.01 


-.06 


.13 


-.05 


.07 


-.16 


-.16 


Abstract Reasoning 


-.13 


.11 


.10 


.14 


-.21 


-.12 


-.03 


PCT A 


-.19 


.09 


.04 


.19 


-.20 


-.26* 


. .19 


PCT B 


.09 


-.07 


-.10 


-.20 


. 26* 


.24* 


-.18 


Multiple R 


.34 


.21 


.30 


.28 


.39 


.50** 


.33 
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Chapter V 
Conclusions 



The author found that 51 of 82 retested engineering 
students had raised their freshman LAD scores to either 
the highest or next to highest category used by the 1962 
scoring team and 74 of the 82 were placed in the top 4 
scores of a potential 14 point range of _ LAD scores. From 
Table III we can see that 44 or over half ox. the 1958 
scores were scores of 10 or 1 ess while only 8 of the 
same 82 students scored that low in 1962. 

It seems reasonable to conclude that the improvement 
was produced by their 4 years of engineering mathematics 
and science study rather than by a practice effect or by 
maturation. The author recalled a similar outcome wnen 
spatial relations' skills were measured before and after 
4 years of engineering study. In that case, most o ® 
chancre occured during the freshman year. Similar studies 
had revealed that high spatial skill was a distinctive 
characteristic of engineers on-the-job. 

In Chapter IV a comparison of the LAD scores by 
curriculum areas among the 4 offered at Cooper Union 
showed some interesting differentials (Table V). The 
median LAD score of 9.0 for the chemical engineering 
majors was the lowest of the 4 groups and their final 
scores in 1962 median 10.4 on the 1 hr. list was also 
lowest. The median for all was 11.2. However, the 
median College Board test score for the chemicals was 
about h sigma above the civils and mechanicals., fhe 
mechanicals who rated near the civils. on academic tests 
stood at the top of median LAD score in 1953 10.9 and 
equaled the BS's 133 on the lh hr. LAD in 1962. The 
electricals and mechanicals 13 „ 3 came so near tne ceiling 
on the lh hr. 1962 tests that a separate study was made 
of the percent of possible gain for each student (See 
Appendix — 3uchanan) • No viable conclusions -e*^e 
reported from this refinement in scoring. 

some correlational studies and some attempts. to 
group the mass of personal and intellectual data into 
smaller clusters of related items were reported. 

When the faculty rated the seniors on Creativity 
their ratings were positively correlated with LAD scores 

. 32 . 
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The correlations of LAD *58 with freshman grades .28 
and with 4-year cumulative grades .19 were not as high as 
the senior-year 1962 1 hour test which reached a .39 with 
the 4-vear cumulative. 



\ 



These show a strong positive relationship similar to 
the correlationships regularly noted between spatial 
relations scores and engineering school grades even 
though later factor analyses regularly separated both the 
LAD and spatial test scores from factors containing the 
grades for classwork. 
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In Table XIII we presented a 5 factor analysis of 19 
Cognitive Intellectual and Academic Achievement Variables. 
Separation of School and College Averages from most 
Verbal and Quantitative Admission Test results was 
surprising. Only the College Board Advanced Mathematics 
and a tendency to give common responses on the Kent- 
Rosanoff Word List were associated with high school and 
college grades. On the other hand, 0333 Physics and 
SAT Verbal Scores, Yale Verbal Reasoning, Mechanical 
Ingenuity and Numerical Reasoning were associated with the 
LAD in a factor independent .of grades. The other 3 factors 
centered upon scores on the Physiognomic Cue Test, Word 
Association and the Embedded Figures Test. 



The LAD scores by themselves failed to predict 
career choices in 1967. The 19 who left before graduation 
had a mean score of 9.6 and the 18 not filing career 
reports scored 8.9. Both means are lower than the 1953 
mean scores of the 60 subjects who did file a 1967 career 
report. 39 of the 66 reported careers v?ith a high need 
for theory (teaching, research, etc.). They had a mean 
score of 10.8 in 1958 but the 21 reporting sales, 
management and other less theoretically demanding careers 
had a mean of 11.0 for their 1958 LAD scores. None of 
these differences in career group LAD means are significant 
at the .05 level. 



Finally, Dr. Rosett's analysis of factored responses 
to a career choice questionnaire when correlated with 
cognitive and intellectual factor scores showed that 
such groups of test and attitude information were 
significantly correlated with clusters of attitudes 
toward occupation some 5 years later in 7 out of 21 
relationships studied. 




1 

: 



There seems to be little value in the LAD as a single 
predictor of success in engineering school or of career 
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preference. However, groups of predictor variables 
combined and weighted by factor analysis and correlation 
techniques do show moderate success in predicting school 
grades and career choices. 

Further experimentation with predictions based upon 
larger and more diverse populations seems justified. .In 
view of the expense of administration there is not 
sufficient evidence of the value of the LAD to warrant 
including the LAD in the predictor variables of such 
extended studies. 
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APPENDIX A 



Subject: Further Analysis of LAD Per fomance of n 

nninn Enaineer 1 nq Stuaents * • 



Coooer Union Engineering 



When 81 of the original 96 students were ^"tested 
the Logical Analysis Device, it was found, tnat there ^ - 
a General trend toward improvement m tne ability o^ \ ne 
students to solve the LAD problems. However, the stuaents 
v?ere given a one hour time limit when tney > too* the e u 
in 1958 whereas they were given 1.5 hour time limi 
1962 re-t^st. In order to make the results more 
comparable the ratings were also evaluated on the basis 
Of one hour performances. These one hour 1 ® tin | s v 

showed the general trend towards ^improvemen • - / . 

of this data appears in Table ill below. 

Table. XVIII 



Group 



M ean Improvement in LAD Rating 

N 



Mean 1" hour 
Improvement 



Mean 1.5 hour 

Improvement _ 



All engineers 
Mech. Eng. 
Elec. Eng. 
Chern. Eng. 
Civil Sng . 



81 

21 

20 

19 

21 



.94 

.81 

.95 

.47 

1.66 



2.25 

2.05 

2.40 

1.68 

2.95 



Pif f . 

1.31 

1.24 

1.45 

1.21 

1.29 



However , some students could not improve their ratings 
since th~y received the top rating in the. 1358 test and 
the 1962 re-test. Accordingly, the mean improvement was 
calculated eliminating the scores of those students. The 
results appear in Table XI : X below. 

Table XIX 









Could Improve 










N 


Mean 1 hour 
Improvement 


Mean 1.5 hour 

Improvement 


Diff 


All Engineers 
Mech . Eng . 
Elec. Eng. 
Chem. Sng. 
Civil Eng. 


74 

20 

16 

17 

21 


1.03 

.85 

1.19 

.53 

1.66 


2.49 

2.15 

2.80 

1.88 

2.95 


1.46 

1.30 

1.61 

1.35 

1.29 
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Since some groups started at higher mean. levels than 
others, absolute improvement might be slightly misleading. 
Therefore, the relative improvement of each group was 
calculated (relative improvement = mean improvement /amount 
of improvement possible). The results of such calculations 
appear in Table XX below. 

Table "XX 

Relative Improvement, 



1 hour relative 1.5 hour relative 
Grouo N improvement i mprovement __ _ 



VJJ- 

All engineers 


74 


III VV V# » 

• 28 


.68 


Mech. 3ng. 


20 


.28 


• .71 


Elec. Eng. 


16 


.40 


.S3 


Chem. Eng. 


17 


.14 


.49 


Civil Eng. 


21 


.32 


• 57 



Additional gross indications of improvement were also 
calculated: (1) highest problem attempted in equivalent 

total time? (2) problems completely solved in equivalent 
total time; and (3) highest problem solved in equivalent 
problem solving time (to correct for differences in 
instructional time). The results appear below in terms 
of the number of individual students in each of the three 
assessment categories. 



Table XXI 



Additional Problems Tried 


and 


Solved 


in 


Equivalent Times 


Category of Improvement 






Additional 


Problems 




N 


-1 


0 


+1 


+ 2 + 


(1) Highest phrn. attmpted 


81 


6 


40 


31 


4 


(2) Highest p bra .solved 


81 


3 


29 


38 


10 1 


(total time) 












(3) Highest phrn. solved* 


74 


3 


25 


41 


3 2 


(pbrn- solving time) 













* Used only those who could improve 



2-Level Problem Analysis 



The results of the previous analyses show that not only did 
students generally Improve their total performance, bit 
that they" also attempted and solved more problems in the 
same time. In order" to see whether some groups made better 
use of their previous experience than others and whether 
certain groups could be discriminated on the basis^ of 
their approach and total performance on the LAD, the 
highest* problem solved by most of the students (the 2-level 
problem)' was analyzed in terras of the process by which 
each student solved the problem. 

The initial approach made use of a measure called the 
Analysis-Synthesis ratio (A:S ratio). An analytical move 
is one which consists of one or more button pushes in the 
same time period, while a synthetic move consists of two 
or more button pushes in more than one time period. 
Therefore, the analysis-synthesis ratio is the number of 
analytical moves to one synthesis move used by the student 
in solving a problem. The A:S ratio score for problam 2 
was derived for each student for each session, and the 
scores were correlated. The correlation was essentially 
zero. Further analysis of the data showed that the students 
tended to be more analytical the second time as measured 
by the A:S ratio. In order to see whether the increase 
was general or related to the general improvement shown 
by the students, the total group was divided into four 
groups: (1) those who improved their performance? (2) 

those who did not improve their performance? (3) those who 
could not improve because they received the top rating in 
both the 1953 and 1962 tests? and (4) those who did more 
poorly on the second test. Improvement was separated into 
two categories, improvement for equivalent time in both 
tests (1 hour 1S6 2~) and improvement with increased time 
in the second test (1.5 hour 1962). The results of such 
comparisons are shown below in Table V. 

Both the improved group (1) and the group that could not 
improve (3) showed expectedly higher. A:S ratios on the 
second test. However , the group that did not improve had 
lower A:S ratios for the second session. It would seem 
that this group should show equivalent A:S scores for both 
test sessions if the ability to solve the problem is a 
function of t'he degree of analytical ability exhibited 
and if the A:S ratio is an accurate assessment of that 
ability. The fact that the difference is not in the 
expected direction suggests that either the students were 
less analytical the second time but still managed to solve 
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the problem or the A:S is not a representative measure oj. 
analytical ability. A non -significant correlation^ ^ 

(R s .173) betv/een the 1962 one-hour LAD rating ana tne 
A:S ratio score for that session tends to support the 
latter contention. 



Table 

‘ r > ■ — 1 



Mean AsS ratios by 



C ategories of Improvement 



Group 



(1) Improved 44 

(2) Not improved 10 

(3) Not improved 7 

(top rating 1953 & 1962) 

(4) Did' more poorly m 16 

Total 77* 



AsS 

1953 


ratio 

1962 


Difference 

1962-1958 


- 1953 


ratir^ 




6.63 


8.50 


1.87 


6.66 


4.41 


-2.19 


7.03 


9.86 


2.83 


5.58 


5.13 


-0.45 



( 1 ) 

( 2 ) 

(3) 

(4) 



1962 1.5-hour 


r at i ng - 


Improved 


55 


6.39 


Not improved 


5 


8.70 


Not Improved 8 

(too rating 1958 & 1962) 


6.80 


Did more poorly 

Total 


9 

77* 


7.85 



1953 rating 

7.56 

6.33 

3.75 

5.79 



1.17 

-2.37 

1.95 



-2.06 



* 4 of the 81 students did not attempt the 2-level 
problem in 1958. 



Nevertheless a second analysis using the A:S ratio was an 
attempt to identify student majors by their mean as S ratio 
scores. The results of such analysis are snown oelow, 
along with the mean improvement scores of those groups. 



Table XXIII 



M e a n AjS ratios for Major Fields of Concentration 



Group 



iN 



Mean 

A : S Ratios 
1S53 1962 



Difference Mean Imp. 
1962 1953 1962-1953 

1 hr 1.5 hr 



Relative 

Imp. 

1 hr 1.5 



hr 



Mech . Eng . 
Elec. Eng. 
Ch era. Eng. 
Civl.Eng. 



20 


8.71 


9.58 


.87 


.85 


2.15 


.28 


IS 


6.50 


7.40 


.90' 


. 1.19 


2.80 


.40 


19 


5.34 


5.80 


.46 


.53 


1.83 


..14 


20 


8.74 


6.89 


-1.90 


1.66 


2.95 


.32 



.71 

.93 

.49 

.57 
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For the first three groups the results seem reasonable. 

The greater the increase in the AsS ratio# the greater the 
increase in the LAD rating is shown by that group. 

However, the group that exhibited greatest absolute change 
(Civil Engineers) and the next to greatest relative 
improvement for 1 hour 1962, also showed a lower mean AsS 
ratio the second time. Again there is the possibility 
that the A;S ratio is not an accurate measure. 

If a student made a great number of highly redundant, 
illogically organized analytical moves, his AsS ratio 
would be spuriously higher than that student who needed 
to make only a few key moves to discover the key relation- 
ships. In order to correct for this possibility, a new 
measure called the NRAsS ratio was devised (non-redundant 
analytical-synthesis ratio). This was the number of non- 
redundant analytical moves to one synthetic move, rather 
than just the number of analytical moves to one synthetic 
move. This ratio was then correlated with the one-hour 
performance rating for 1962. The results, along with the 
previous correlation are given below. 

Table XSIV 

NRAsS and A;S vs. 1962 (1-hour) LAD Ratings 
Measure N r 



NRAsS 77 .381 

A:S 77 .173 



The predictive ability of the new measure is better than 
the original AsS ratio. In order to see if this ratio 
could also predict some change in performance, the 
difference between the rating of the students on the 
test-retest situation was correlated with the change in 
the NRA :S. The r = 0.574. This indicates that those 
students who adopted more analytical approaches in the 
second session were also those students who did better on 
the total rating. f 

Since the elimination of redundancy for the AsS ratio 
resulted in better predictive power for that type of 
measure, a Redundancy Ratio was derived for each of the 
students who attempted the 2-level problem in both 
sessions. Correlations were run between redundancy (that 
is the number of non-redundant analytical moves/the total 
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number of moves) and the ratings for the 1958 test and 
the 1 hour performance ratings on the 1962 test. Also, 
the change in redundancy v;as related to change rn 
overall test performance. The results are summarized in 

Table 



TABLE XXV 



2-Level Problem Redundancy Ratio and Lad Ratings. 
Measure vs. IAD te st N X_ 



Redun. Ratio 
Redun. Ratio 
Redun. Change 



1958 74 
1962 (1-hour) 74 
rating chge. 74 



.581 

.570 

.379 



It can be seen that this measure seems to be a stable 
predictor of total performance rating, but it is less 
proficient in its. ability to predict improvement in 
performance. An alternate analysis of comparable tapes 
for the second level problem v;as undertaken using as a 
measure an analysis called the utility index (U). The 
utility index of a particular analytical question was 
derived from the formula 



U = 



NQ 



where NQ = the number of subjects who asked a particular 
question and N = the number of subjects in the sample. 



The best utility index for a particular question would be 
1.00; that is, a question that is asked by all the members 
of the sample. Of the 19 possible analytical questions 
(see Figure 1) necessary to solve the problem, only the 
combinor relationship necessary to light the 
was asked by all the students. The range of mean utility 
, scores ran from 1.00 (for the comoinor to the center 
light) to 0.37 (the check on the preventor to the center 

light). 
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Figure 1 

2-level Problem Diagram and List of Utility Scores 

for Key Questions 




Question # 
Mean U Scores 

G # 

M.U.S. 



1 


2 


2 


4 


5 


6 


7 


8 


9 




.67 


.68 


.61 


.52 


.51 


1.00 


.37 


.80 


.86 




10 


11 


12 


13 


14 


15 


16 


17 


18 


19 


.79 


.44 


.57 


.63 


.59 


.63 


.86 


.47 


.66 


.76 



The utility indexes were also derived for each session and 
were plotted on a graph to show their range of importance 
and relative change in importance (see Figure 2). The 
ordinate was the utility index for session one and the 
abcissa was the utility index for session two. If a 
question was of equal importance the second time, it 
would fall on the line bisecting the 90° angle of the 
X and Y axis. If it was less important, it would fall 
below the line, and if it was more important, it would 
fall above the line. 
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Figure 2 



Plotted Change in U Scores 



1.0 

Q 



V scoaff 
SESSION a 



.1 

.4 

.5 



• 6 



/ *16 
✓ ;?e 



>8 



/ .o •« 

12 • » * 8 
* © i? • • 



•*<>/ 

✓ 

/ 



' V* 

• 17 

• It 



I* 3 



*3 



.£T *6 •*! *»0 

✓ 

V 

U SCORi: » Sf«5iON I 



Only three cruestions were more important the second time 
while 15 were more important the first time. Two of the 
questions (#6, #15) were equally important in both 
sessions. However, the fact that there were some questions 
that were more important the second time and some questions 
that were less important the second time give clues to the 
increased ability of the students to solve the 2-level 
problem. By asking key questions a greater proportion of 
the time, the students eliminated much unnecessary and 
low powered analysis in favor of analyzing those elements 
of the problem which were most crucial to the solution of 
the problem. Correlating the U scores for both sessions 
gave a rho= .925 and an r = .88. That is, the more important 
questions maintained their order of importance, but became 
relatively more important. The students apparently 
realized the importance of certain analytical moves the 
second time. 

Because of the fact that students with certain majors 
differed in terras of their mean LAD achievement and 
improvement (Table X, II and III), and because of the fact 
that some of their achievement could be predicted by the 
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number of necessary analytical moves that they made, there 
v/as the possibility that the students could also be 
separated in terms of the efficiency of their approach 
to the LAD problems that might tend to correlate with their 
choice of major field. Accordingly, U scores were 
calculated for each question for each major, and the data 
was subject to an appropriate analysis. While there 
a oredictable significant difference between questions by 
their U scores, there v/as no significant effect on the 
U scores by major. 



An alternative approach using the data v/as then . 
investigated. It was suspected that persons ashing more 
of the key questions would stand a better chance of 
achieving a higher rating than those asking fewer key 
questions. Therefore, the total number of key analytical 
questions was tallied for each student (for session 2 ) and 
the resultant score (NR A — sum of non- redundant analytical 
questions) v/as correlated with the LAD rating. The 
r= -.502. This low, negative and significant correlation 
is surprising. Apparently, as was the case v/ith the 
first AsS ratio, the measure did not discern betv/een 
students who had to ask only a few very important 
questions to solve the problem and those students who 
needed to ask a large number of less key questions in 
order to solve the problem. Since it seemed that those 
questions involving more complex relationships should be 
more imoortant than those involving less complex and less 
important relationships, the ENRA was readjusted to a new 
score (WNRA — sum of weighted non-redundant analytical 
questions). In this scoring system, those questions 
involving two button pushes were given a weight of two, 
while those using just one button push were given a weight 
of one. These scores were correlated v/ith the LAD rating 
and resulted in a smaller yet still negative correlation 
(r e -.245). Again this measure failed because of its 
inability to discern between a few key moves usedin an 
elegant approach to the problem and the large number of 
moves used in a low-powered analytical approach. 



An alternate analysis approach v/ould assign the mean U 
score value to each non-redundant analytical move made 
by the student. The total of these scores would be his 
total U score, and this value v/ould be divided by the 
number of non-redundant analytical moves the student made. 
The resultant score might then be related to the LAD 
rating. By making use of the optimally weighted values 
of each analytical question, such a measure would discern 
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between the low-powered analysis of the poorproblem 
solverandthe efficient, high-powered analyses of the 

sharp person. 

However, because major field of concentration "ot 

be identified by approach to the LAD probl^. it would 
be hard to justify the additional number of computations 
necessaryto obtain this optimally weighted problem- 
solving score. 



of 2-level Problem Analy sis. 

In terms of the present analysis, it can b ® , 0 ^^^ 
improvement shown ty the students J* 

of their ability to grasp and use their undersuanding or 
the logical structure of the LAD problems. Those 
students who improved tended to bemore analytical a 
more selective in their analysis of the problems. Those 
students who had done well on the first test , ge "^ a .L er 
did even-better on the second. Those students wno either 

did not do as well or did not improve . their . fl??ficultv 
aenerally were' less analytical and had greater difficu y 
grasoing and using the efficient approach to problem. 

In terms of separations, both the Mechanical engineers 
and the Electrical Engineers made the most of their 
previous experience with LAD given an extra ' 

^lile the Chemical Engineers did not improve their 
performance as greatly. While objectification 
taoes shows that certain forms of analysis tended o 
predict performance and improvement , _ such analysis was 
not able to identify, with any certainty, students o . _ 
different major choices. While the analysis could ident y 
seme of the students, this could also be 
their overall achievement. Certainly g roups 
identified only by their approach to a 

least with the present hind or analysis. Prom the data 
it is doubtful that persons with certain major choices 
have any particular mode of approach. Those who have 
chosen Mechanical or Electrical Sngineeringtendtodo 
better, while those who have chosen c tf rnlcal . ' 0 ^ 
Engineering tend to do more poorly. Those w o 
with the closed logical system of LAD tend to do better 
because they adoot the system more easily than 
do not do so well. Were there 

approaches to the same problem it might be possible to 

discern approach differences or preferences. 

absence of that freedom, those who do well have adopted 



the most efficient system while those who do not do as well 
have not. 



LAP Performance in Relation to Other_M easures 

Since the restrictions of the LAD test limit the analysis 
of the results, various investigations were undertaken 
relating to the total LAD performance ratings to other 
measures of the students* achievement. 

The Cooper Union Entrance Scores were correlated with 1958 
and 1962 LAP ratings for the 81 students who took both 
tests. In addition to correlating these scores for the 
group as a whole, correlations were also run for each of 
the four major fields of concentration. The results are 
summarized in Table XHYI • 

Table XXVI 

LAP ratings vs, Cooner Union Entrance Scores 

Grouos N 1958 LAD ratings 1962 LAD ratings 

• • r= rs 



Ail engineers 81 
' Mech. Eng. 21 

Elec. Eng. 20 

Chem. Eng. 19 

Civl. Eng. 21 



.070 

.080 

-.045 

-.033 

-.063 



-.140 

-.030 

.430 

-.690 

.066 



The correlations of the 1962 LAD ratings and the Cooper 
Union Entrance Scores for each of the majors would be 
interesting were it not for the fact tnat the Ns were 
small and a few cases spuriously distorted the data. The 
essentially zero correlations with the 1958 LAD ratings 
present a far more realistic picture. 

The LAD ratings were also correlated with the entrance 
tests given before the freshman year in addition to 
measures of the students' achievement. The results are 
given below in Table XXVII 



Table XXVI X 



1958 LAP ratings 
LAD vs. 



vs. Test Scores and Academic A^ieve ment 

Entering Class (N=96) Drop-outs (N=20) 
r= r " 



SAT (Verbal 

(Numerical ) 
Yale (XII) 

(IV) 

(VII) 

Adv. Math 
Cum. Ave. (N=8l) 



.138 

.103 

.323 

.220 

.358 

.550 

.136 



.147 

-.084 

.393 

-.125 

-.007 

.212 



In order to see if improvement in LAD performance was 
related to either the Cooper Union Entrace Score ° r 
scholastic achievement, these measures were correlated, 
and the results appear below. 

Table XXVIII ‘ 

LAD Improvement vs. Entranc e S cores ._ a^ ^ Academ ic Achi e v e ned 

LAD Improvement ^ r 

vs - — - — — “ 



Cum. Ave. 

CU Ent. Score 



72 

72 



.062 

.039 



Summary 

LAD ratings and improvement have moderate relationship 
with only a few of the other measures and essentially no 
relationship with the others. The only relationships that 
seem to have some predictive utility are those relation- 
ships which are moderately present for the students who 
comolete their training at Cooper Union, and not present 
for" those students who leave the engineering program. 

(see Yale IV. VII and Advanced Math, Table XXVII J 
Unfortunately, the snail size of the drop-out sample and 
the diversity of reasons for leaving the engineering 
program make such a contention tenuous at best. 

An exolanation for the few significant relationships is 
related to the level of ability exhibited by the Cooper 
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Union freshmen. The mean LAD rating in 1958 was high 
(B-) with almost 19 % of all the students and almost 20% 
of those who took the re-test receiving the top rating. 

In addition, the Engineering students were a highly 
select group — the lowest SAT score being in the 590 
range. A normal distribution of ratings would hardly be 
expected from such a group. 

Since the LAD rating is a reflection of the student's 
ability to grasp and utilize the closed logical system of 
the problems, those students who achieved high rating would 
be expected to exhibit the logical tendencies identified 
by a thoroughgoing analysis of their approach to the 
problems. Where the abilities brought into play in the 
solution of the LAD problems are similar to the abilities 
needed to achieve certain academic endeavors, it would be 
expected that achievanent in those endeavors would be 
reflected in the LAD performance. It is possible, therefore 
that identifying the abilities needed for certain classroom 
tasks could be done with the Logical Analysis Device. 
However, the use of the LAD test as a predictor of total 
academic performance does not seen to be supported by the 
present data nor the foregoing analysis. 



APPENDIX B 



Word Attitude Questionnaire (WAQ) 

Used for 1967-68 follow-up to 1962 graduates. 
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WORK ATTITUDE QUESTIONNAIRE - (WAQ) 
PROJECT 1*726 - COOPER UNION 



Code Number 



Pate 



Part I 

In looking forward to your future career, what activities are most 
important "to you? Please rank-order the following activities r 
abilities according to the extent to which they are impor an 
you. Assign a rank of “l" to the activity that is most i^por a . 
to you, and a rank of "13" to the least important. Be sure to rank 
all items and do not assign the same rank to more than one. 

Ranks 



Originating and developing ideas for useful products 
or processes . 



Effectively communicating ideas and findings througn 
.writing or talking to other professional persons (sci- 
entists and/or engineers). 

Planning for and solving problems of fa.cllitles, serv- 
ices, budgets, or personnel for research, 

Being able to get along with colleagues and superiors 
In the research organization. 

Developing and carrying out the scientific or engineer- 
ing ideas of others. 



To stay with a company for a l?ng time. 

Independently carrying out your own ideas. 

Carrying out the routine aspects of the x^ork efficiently 
and accurately. 



Knowing the rierht people. 

Planning an* directing the research programs of other 
professional men. 

Working in close cooperation with salesmen, customers, 
contractors, etc. 

Effectively "selling” ideas and findings through writ- 
ing and/or' talking to management or customers. 

Making original discoveries of theoretical value for 
the growth of scientific and/or engineering knowledge. 
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WAQ 



Code Number 



Part II 

The technical work of scientists and «£«»« °£"ent o^u” 0 *' 

s;sriri.)? l *5nJ«r~.r”t"5-?oi<" m* »«■ s? “ es - 



Percent 
of work 



A. Research (discovery of new knowledge either 

basic or applied) • • • • 

1. General knowledge relevant to a broad ^ 

class of problems - ■ 

2. Specific knowledge for solution ^ 

- of particular problems - /0 

Subtotal should equal item A * • ) 

B* D evelopment and invention^ design of P a rticulai 
products or processes; translating know g 
into useful form) * 

3. Improvement of existing products or ^ 

processes " ' 

4 . Invention of new products or processes .. 

Subtotal should equal item B * ■ * * ^ ^ 

c. Technical services to help other people or groups.. 

5. Testing; use of standardised techniques to ob- 

tain data needed by others *' * - /0 

'of a 

6. Consultati on, trouble-shooting * — — 

Subtotal should equal item C *( lf fi ^ 

D. 7. Teach ^ng^_and/o r supervision of college students.. 

E. 8. Other purposes:^ — 

Total time should add to 100$ * 



% 



~J° 



t 



1o 






( . „A ) 
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WAQ 



Code Number 



Part III 



Some individuals are completely involved in their technical work- 
absorbed in it night and day. For others, their work is ^ nly on , ? 
of several interests. How involved do you feel in your work and stud*? 

CHECK ONE answer. 



Not much involved 
Slightly involved 
Moderately 



Strongly 
Very strongly 

Completely; the most absorbing 
thing in my life 



Part IV 



Scientific and. engineering activities call for a variety of abilities, 
some o^ *'hich are listed below. Being as objective as you can, now 
do you feel you stand on each ability, compared with other s — o__ 
similar training in the same field? 



Please MARK ACROSS 
mark at "67" means: 
thirds of others in 



BACH SCALE at the appropriate point. Thus a 
"on the average" you feel you stand *bove two- 

the field. • ' ^ , . 

I stand approximately above: 

1 % 10 % 30 % 50 % 70 ; % 90 % 99 % 

t 1 « 1 ] 1 l i ! ! L 

( low) ( high) 



A. Technical ability (sound 
training, kno^-how, grasp 

of field) 

B. Creativity ( imagination, 
originality; thinking of 
better ways to do the Job). . 

C. Methodicalness (thorough- 

ness, carefulness, 
precision) 




D. Energy (hard work, drive; 

meeting schedules; large 
output ) 

E. Critical ability (sound 
evaluation of ideas; 

clear thinMng) 



■ 1 r ! ■ I . I i i 



I L 

10 



» t L 

30 50 



70 



_J L 

90 
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WAQ 

Code Number . 



Part VI 

Listed' below are different kinds of opportunities which a Job might 
afford. If you were to seek a Job, how much importance would you 
personally attach to each of these (disregarding whether or not your 
present Job provides them)? 

Importance I would attach . 

'Slight Mod- Cons id- UN- 
CHECK ONE in each line or none erate erable Great most 



A. to make full use of my 

present knowledge and skills 



B. to grow and learn new 

knowledge and skills 



C. to earn a good salary . . . . 



D. to advance in administrative 
authority and status. . . . . 

E, to work with colleagues of 
high technical competence . . 



F. to have congenial co-workers 
as colleagues ........ 



G. to work under chiefs of high 
technical competence 



H. to associate with top exec- 
utives in the organization. . 



I. to build my professional 

reputation 

J. to work on difficult and 

challenging problems 

K* to work on problems of value 
to the nation’s well-being. . 

L. to have freedom to carry out 

my own ideas . . 

M. to contribute to broad tech- 
nical knowledge in my field . 



N. Other: 



WAQ 



Part V 



Code Number 



Scientists and engineers may differ widely in their character ist ic 
approach to their work — both the kinds of problems that attrac 
them, and the way they go about the task. How closely does each 
•statement describe the approach you typically prefer to use. 

(Note: try to ignore limitations set by particular conditions of work 
and describe the approach you prefer . ) 

How closel y statement de scribes ine 
Not Mod or- Com- 

all ately piste 

CHECK ONE in each line 0 % 15 % 30 % 5 0$ 70 % & 5 % 

A. I mainly prefer problems that 

are interesting in themselves. — — ~ 



B. I mainly prefer problems that 

will help to build my profes- 
sional reputation 

C. I mainly prefer problems that 
* will lead to advancement in 

organi ?.at lona.l status 

B* I prefer areas where I can be 
fairly sure of some accept- 
able results , even though not 
spectacular 

E. I prefer, to ma.p out broad 
features o f important new 
areas, leaving detailed study 
to others ........... 

F. I prefer to probe deeply and 

thoroughly in selected areas, 
even though narrow 

G-. I’m rather a lone wolf ;- prefer 
to work by myself 

H. I’m a strong team man ; work 
best in collaboration with 
colleagues 

X. I'm effective as a " right hand 
man," carrying ball for a more 
experienced advisor 

J. I prefer to develop my ideas 
" inside my head ," before 
testing them against nature. . 

K. I am stimulated by problems 

met in trying to control the 
external environment 
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WAQ 

Code Number _____ 

Part V (Continued) 

CHECK ONE in each line Of 1 5f 30 f 50f 70f 8 5f 1 °° % 

L. I prefer to spend enough 

time to find general prin- 
ciples that apply to many 
situations 

M. I r>refer to find immediate 

solutions to specific 
problems. 

N. I f'ind it fruitful to utilize 

abstract concepts several 
steps removed ^rom direct 
observation 

O. I prefer to find out all I 

can by observation , before 
trying to generalize 

* 

P. X like to bring about order 

and simplicity in chaotic or 
complex material 

Q. .1 enjoy finding loopholes and 

contradictions in previous 
efforts to explain an area. . 

R. I prefer to plan a long-range 
series of related tasks , whi c h 
I follow more-or-less system- 
atically. • • . • • • • * • • 

S. I prefer to alter my direction 

from week to week as new deveL 
oPments arise 

T. Some of my friends think that 
my ide»s are impractical if 
not a bit ^'Tild ........ 

U. Straightforward reasoning 
appeals to me more than meta- 








r*BN*p 






m 







r 




APP3MDIX C 



lr^<0)2?2riaci , & , A(Din5. alb ©■&&■& 



SLog&eaE ^saaE^siLs IDe^Eee 










The Logical Analysis Device is used to test problem- 
solving ability. The Psychological Corporation has 
developed standardized procedures for using LAD for 
selection and assignment of personnel and for applied 
research in the best placement of highly trained and 
talented people. 

The LAD problems are unambiguous examples of 
a completely defined logical system. They closely par- 
allel the diagnostic or trouble-shooting situation. No 



specialized experience or knowledge is required. 

The logical complexity of the LAD problems can 
be quickly changed. By presenting a series of increas- 
ing difficulty, it is possible to measure an individual’s 
ability in organizing complex information and to ob- 
serve his directness of attack, speed of work, recogni- 
tion of logically useful information, activity when 
frustrated by an error, and other elements of behavior 
associated with problem-solving. 
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Problem-solving situation tests can be put before 
a person in a large variety of ways. 1 he Psychological 
Corporation has limited its attention to the develop- 
ment of the LAD as a method of evaluating per- 
sonnel for critical job assignments - those for which 
special abilities and characteristic thinking habits are 

important. 

The introduction of a person to the LAD logical 
system has been standardized in a form which creates 
an optimal situation for observing an individual’s 
characteristic modes of attack on logical tasks. All 
the rules of the system are demonstrated, explained, 
and reviewed with practice exercises. A written sum- 
mary is provided for reference, and the simplest, most 
effective method of solution is demonstrated. Ques- 
tions may be asked of the examiner at any time. The 
individual being tested has complete freedom to work 

in any manner he prefers. 

After the introduction which requires ten to fifteen 
minutes, the work is done in isolation without any 
personal interaction with or pressure from the 
examiner. 

The problems are presented in a graded series of 
complexity. After each problem the examiner reviews 
the logical content of the exercise and demonstrates 
a simple, effective method of finding the solution. 

The purpose of this careful presentation is to elim- 
inate the possibility that the instruction or the nature 
of the task might be misunderstood. The examiner s 
function is to make certain that every person tested 



has been explicitly and repeatedly shown simple and 
effective methods. 

The fact that many persons cannot or will not me 
demonstrated logical methods even when the methods 
of their own choice are ineffective indicates the kind 
of important individual characteristics that are identi- 
fied by the LAD testing. 



The nine lights in the circular display panel can 
be turned on by manual operation of the adjacent 
push-button switches. The target light in the center 
has no switch. The operator’s first step in solving the 
' problem is to find out by experimental trials which 
combination of lights has the effect of turning on 
the center light. He is aided in planning his trials by 
an information diagram consisting of arrows linking 

pairs of lights. 

Prior to tackling a problem, he has been instructed 
that each arrow represents one of three possible 
cause-effect relations, and the meaning of the rela- 
tions has been disclosed by actual demonstration on 

the device. 

The second phase of the solution involves analysis 
and experiment to ascertain the effccis of the arrow 
relations that are not directly associated with the 
target light. 

The third and final step in the solution is achieved 
when the operator can control the automatic rela- 
lions and turn on the target light by some sequence 
of operations, restricted to the three buttons num- 
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be red 4, 5, and 6. This phase requires synthesis of 
all the information acquired in the analytical phases. 

Evaluation of the 
Performance 

The rating of performance is accomplished by 
analysis of an objective printed record of the actual 
operations on the display panel. Several factors are 
observed. The number of problems solved in rela- 
tion to the highest level of complexity attempted, and 
the time required, indicates the power of the indi- 
vidual. Scrutiny of the details of the performance on 
individual problems reveals whether the • character- 
istic mode of approach was analytical or non-analy- 
tical. The objective scoring of each problem is sup- 
plemented by the examiner’s ecord of the operator’s 
understanding of the logical content of the problem. 
Individuals whose performance lies in the intermedi- 



ate region between a consistently analytic and a 
totally non-analytic approach are described by such 
statements as the following: 

“Initially analytic but abandoned analytic methods in 
the more complex problems .” 

OR 

“The analytic approach used at the beginning of all 
problems was given up when the solution was not 
immediately demonstrated.” 

OR 

“Analytical methods adopted when other methods 
failed to produce the solution.” 

OR 

“ Some evidence of an effort to use analytical methods, 
but the process seldom carried through to a definite 

result.” 
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The LAD Cox&sists of s& 
display Panel and Five 
Auxiliary Items 
of Equipment 






OPERATOR'S DISPLAY PANEL con- 
sists of nine lights arranged in a circle, 
each with an adjacent push-button 
switch and a tenth target light at the 
center of the circle which has no switch. 
A time indicator light and a re-set but- 
ton are at corners of the panel. 

CENTRAL LOGIC UNIT contains the 
power supply required for all the equip- 
ment, the timing mechanism, and the 
switching circuitry. 

PROBLEM PLUG BOARDS are printed 
circuit cards which may be quickly in- 
serted in the central logic unit to 
change problems. Problem, changes re- 
quire only the few seconds necessary 
to extract one plug board and insert 
another. 




DISCRETE EVENT RECORDER prints 
the number corresponding to every 
effective push-button operation. The 
printed tape provides a legible, com- 
plete, timed record of every action 
performed on the Operator’s Display 
Panel. 




EXAMINER'S CONTROL UNIT con- 
tains six switches which permit the 
examiner to print control information 
on the recorder. 



The Complete system can be packed in two carrying 
cases. 

The Logical Analysis Device is not offered for sale. 
A limited number of sets are available on lease for 
significant applied research. 



